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Abstract 

This paper considers some random processes of the form X n+ i = 
TX n + B n (mod p) where B n and X n are random variables over 
(Z/pZ) d and T is a fixed dxd integer matrix which is invertible over 
the complex numbers. For a particular distribution for B n , this paper 
improves results of Asci to show that if T has no complex eigenvalues 
of length 1 , then for integers p relatively prime to det (T) , order (log p) 2 
steps suffice to make X n close to uniformly distributed where Xo is the 
zero vector. This paper also shows that if T has a complex eigenvalue 
which is a root of unity, then order p b steps are needed for X n to get 
close to uniformly distributed for some positive value b < 2 which may 
depend on T and Xq is the zero vector. 
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1 Introduction 



Previous work has looked at the following random processes on Z/pZ. These 
processes were of the form 



where X Q = and a n and b n had certain probability distributions. See [2], 
[5], [6], and [7]. The study of these random processes was inspired by some 
pseudorandom number generators used by computers; see, for example, [8]. 
For many choices of the distributions for a n and b n , the distribution for X n 
would be close to uniformly distributed for relatively small values of n (e.g. 
order (\ogp) 2 or order (logp) log(logp)) provided that p is chosen to avoid 
"parity" problems. For some choices of a n (e.g. a n = 1 always), n would 
have to be much larger (e.g. order p 2 ) for the distribution for X n to be close 
to uniformly distributed. 

One can examine similar random processes on other finite structures. For 
example, Asci pQ considered random processes of the form 



where X n , B n are random variables on (Z/pZ) d with Bo, Bi, . . . i.i.d., d is 
constant, Xo = 0, and T is a fixed dxd integer matrix. The main results of 
|1] assumed that T had non-zero integer eigenvalues. One result in [I] does 
not have such an assumption but only requires n to be of order p 2 {\ogp) 
for X n to be close to uniformly distributed on (Z/pZ) d . This paper will give 
significantly better upper bounds provided that the eigenvalues of T are non- 
zero and all have length different than 1. Such bounds apply, for example, 
to the matrix 



X n+ i = a n X n + b n (mod p) 



X n+ i = TX n + B n (mod p) 
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which does not have integer eigenvalues. In this paper, we shall consider a 
specific distribution for B n , but the arguments potentially can be extended 
to other distributions for B n . 



2 Definitions and Main Results 

Throughout this paper, we shall assume d is constant and T is a fixed dxd 
integer matrix with non-zero determinant. We assume X = and P(B n = 
0) = P(B n = ei) = . . . = P(B n = e<i) = l/(d+ 1) where ek is the vector in 
(Z/pZ) d whose k-th coordinate is 1 and whose other coordinates are 0. We 
assume B , Bi, . . . are i.i.d. and 



where G is a finite group (here G = (Z/pZ) d ) and U is the uniform distribu- 
tion on G (i.e. U(s) = 1/\G\ for all sgG). 
One of our results is the following theorem. 

Theorem 1 Suppose T has no eigenvalues of length 1 over C. For some 
value C > not depending on p, if n > C(\ogp) 2 , then \\P n — U\\ ^ as 
p — > oo provided that p is restricted to integers which are relatively prime to 



Note that p need not be prime. 

Another result deals with some cases where an eigenvalue of T has length 

1. 



X n+1 = TX n + B n (modp). 



We let P n (s) = Pr(X n = s 



). Recall the variation distance 



Pn-U\\ 




= mg\P n (A)-U(A)\ 



det(T). 
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Theorem 2 Suppose that T has an eigenvalue which is a root of unity over 
C. There exists a positive value b < 2 not depending on p such that if 
n < p b , then \\P n — U\\ — > 1 as p — > oo provided that p is restricted to the 
prime numbers. 



3 Background for Proofs of the Theorems 

The proofs of these theorems will involve the Fourier transform of P n . A more 
extensive description of this area appears in Diaconis [3]. A representation 
p on a finite group G is a map from G to GL n (C) such that p(s)p(t) = p(st) 
for all s,t G G. The value n is called the degree of the representation and 
is denoted d p . A representation p with degree n is said to be irreducible 
if whenever W is a subspace of C n with p(s)W C W for all s 6 G, either 
= {0} or W = C". The trivial representation is given by p(s) = (1) for all 
s6G. If p2(s) = Mpi(s)M~ l for some invertible complex matrix M, then 
the representations p% and p2 are said to be equivalent. Every irreducible 
representation on a finite group G is equivalent to a unitary representation, 
i.e. a representation p such that (p(s)) -1 = (p(s))* for all s e G where (p(s))* 
is the conjugate transpose of p(s). If p is an irreducible representation on a 
finite group G and P is a probability on G, we define the Fourier transform 

P(p) = 5>(s)p(s). 



The irreducible representations of (Z/pZ) d all have degree 1 and are given 



by 



where q := q(p) := e 2m ^ p and b : 



p c (b) :=g£ti^ 

&2 



and c :- 



4 



c 2 



with 6j, Cj G Z/pZ. 



The representation p c where c is the zero vector is the trivial representation. 

We shall use the following lemma of Diaconis and Shahshahani. This 
lemma, known as the Upper Bound Lemma, is proved in [3J. 

Lemma 1 Let P be a probability on a finite group G, and let U be the 
uniform distribution on G. Then 

\\P ~U\\ 2 <\j^d p Tr{P{p)P{ P y) 

p 

where the sum is over non-trivial irreducible representations p such that p 
is unitary and exactly one member of each equivalence class of non-trivial 
irreducible representations is included in the sum, d p is the degree of p, and 
* of a matrix denotes its conjugate transpose. 

4 Proof of Theorem H 

First we shall develop a recurrence relation relating the Fourier transform of 
P n +i to the Fourier transforms of P n and P\. In doing so, we shall let P n (c) 
denote P n (p c ). The relation is given by the following lemma, due to Asci pQ. 

Lemma 2 If p and det(T) are relatively prime, then 

4 + i (c) = ^ (Pn(T'c)) ^ + jy* j 

where T* is the transpose ofT. 

We shall show that if c ^ 0, then in the sequence c, T*c, (T*) 2 c, . . ., at 
least one of the coordinates of at least one of the first C2 logp terms (where 
C2 is a constant) will not be "near" mod p. 
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Lemma 3 Suppose T has no eigenvalues of length 1 overC Suppose c ^ 0. 
Write c G (Z/pZ) d as an element of Z d with its entries as close to as 
possible (that is c G [— p/2,p/2] d ). Then for some positive values C% and 
C*2 (depending on T but not p or c), for sufficiently large p, (T*)^c has a 
coordinate (viewed in Z ) of length at least C\p but no more than p/2 for 
some non-negative I < C2 log p. 

Proof: Note that since T is invertible over C, then so is T t . Thus, since 
c ^ 0, we conclude (T*)c ^ 0, (T*) 2 c ^ 0, etc. 

Let's write T* in Jordan block diagonal form over C: 



M~ 



for some invertible complex matrix M where 




M 



J, 



(ai 10 
a,- 1 







\ • • • di J 

By the assumption on the eigenvalues of T, 7^ 1. Since T is invertible 
over C, ai 7^ 0. We can write 

J{ 

(TY = m- x I 4 • • I m. 



The following propositions will be used in the proof of Lemma [31 

Proposition 1 There exist positive constants C3 and C4 such that if v G C d 
/ias f large £/ie largest length of a coordinate, then the coordinate of M _1 v 
with largest length has length at least C^vi^^ but no more than C4Vi arge while 
the coordinate of Mv with largest length has length at least (l/C^iarge but 
no more than (1/C 3 )fi arge . 



Proposition 2 If M 1 v E Z d and M 1 v 7^ 0, then at least one of the 
coordinates o/v must have length at least C 5 for some constant C 5 > 0. 

Proposition 3 For some constant C§ > 0, if £ > Cglogp, then all coordi- 
nates of 



which correspond to an eigenvalue of length less than 1 will, for sufficiently 
large p, all have length less than C$ . 

Proposition 4 Suppose C\ is such that (Ci/C^)(\a\ + 1) < 1/(2C4) where a 
is the eigenvalue ofT with the largest length. Suppose all coordinates of Mc 
have length no more than {Ci/C^p. Suppose some coordinate of 



which corresponds to an eigenvalue of length greater than 1 has length greater 
than C5 for some £' < (Cslogp) + 1. Then for some constant C2 > 0, there 
exists a value s < C^logp such that for sufficiently large p, the coordinate 
with the largest length of 



has length at least (Ci/C^p but no more than pjiflC^). 

Proof of Proposition [It Let A be the largest length of the entries of 
M~ l . Then all coordinates of M _1 v will have length at most Adv\ arge . Now 
let B be the largest length of the entries of M. The largest coordinate of 
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M _1 v must have length at least (l/(5d))vi arge ; otherwise all coordinates of 
v = M(M _1 v) would have length under fi arge . The statement about Mv 
follows directly. □ 

Proof of Proposition^ Let C 5 = I/C4, and note that M _1 v must 
have at least one coordinate of length at least 1. Then use Proposition [TJ □ 

To prove Propositions [3] and HI we shall use the following proposition. 



Proposition 5 If 



( a 



J 



then 



, 1 


••• 


°\ 




a 


1 ... 





J 





••• 


a J 




a 1 




ifi 


= 3 


(A) 


a i-U-i) 


ifi 


< 3 







ifi>j 



Note that f m ) is by convention if m and n are non-negative integers with 
m < n. 

Proof: We shall proceed by induction on £. Note that the result is true 
if £ = or £ = 1. Suppose J e satisfies the proposition. We wish to show that 
J e+1 satisfies the analogous result. 

If i > j, note that since J is an upper triangular matrix by the induction 
hypothesis and J is also an upper triangular matrix, then J e+1 is upper 
triangular and (J e+1 )ij = 0. 

If i = j, then {J e+1 )ij = J2 k {J e )ikJki = {J e )uJu = a e a = a 

If i < j, then 



J+i 



{J i+l )ij — J y^ J (J e )ikJ) 



{J )i,j-lJj-l,j + {J )ijJj, 



.13 
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j-l-i 



e + i 



J ~ 1 



(I 



(£+l)-(j-i) 



□ 



Proof of Proposition [3t Note that the largest length of the coordinates 
of Mc is at most C 8 p where C 8 = 1/(2C 3 ) > is a value depending on M 
(and hence T) but not p. 

Suppose a is the eigenvalue (with length less than 1) being considered, 
J is a Jordan block for the eigenvalue a, and proj(Mc) is the projection 
of Mc onto the coordinates corresponding to this Jordan block. Then the 
coordinates of J £ proj(Mc) have length at most 



(imax ( la 



d- 1 



t-d+l 



C 8 p < dt\a\ 
-> 



-d+l 



c 8P 



as p — » oo if (log |a|)Ce < —1 and £ > C 6 logp. The proposition follows. 



□ 



Proof of Proposition 31 In a Jordan block of size 1 and corresponding 
eigenvalue b with \b\ > 1, the result should be straightforward since C*5|6| m > 
(Ci/C 3 )p for some m no more than a multiple of log p and since (Ci/C 3 )p\b\ < 
p/(2C 4 ). 

In a Jordan block J of size c corresponding to eigenvalue b with \b\ > 1, 
let's consider the coordinates of 



jVoj(Mc) 



(b 


1 


■ 


■ °\ 





b 


1 • 


• 








6 • 


• 


\o 





■ 


• b) 



proj (Mc) 



where proj(Mc) is the projection of Mc onto the coordinates corresponding 
to this Jordan block. Let y = I \ = J^proj(Mc). If \yi\ > C5 for some 

\y c ) 

i G {1, . . . , c}, then at least one of the following statements fails: 
Statement 1: \y c \ < C 5 /p c ^ 1 . 
Statement 2: |y c -i| < C 5 /p c ~ 2 . 
etc. 

Statement c: \y±\ < C 5 . 

Suppose statement e is the first of these statements to fail. Suppose r > 0. 
f Wl \ 

Let w = ; = J^' +r proj(Mc) = J r y. Then 

w c _ e+1 = b r y c ^ e+1 + Qr'j/c-e+j + . . . + ^ T _ ^jb r - {e - l) y c 

and 

K-« + ^^r-|C)i^^( 1 -iS)- 

which for sufficiently large p is at least (Ci/C^p for some value of r no 
more than a multiple of log p. (Choose r = [(c + 1) logp/ log |6|J .) This 
multiple depends on c and b but does not depend on p. However, for a given 
matrix T, there are finitely many choices for c and b. So for some value s 
no more than a multiple of logp (where the multiple only depends on T), 
some coordinate of J s proj(Mc) has length at least (C 1 /C s )p provided that p 
is sufficiently large. Furthermore, if this value s is the smallest non-negative 
value for which this statement holds, then this coordinate has length no more 
than (l/2C 4 )p since (Ci/C 3 )(|6| + 1) < 1/(2C 4 ). We can suppose that this 
coordinate is the coordinate with the largest length. 

□ 
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To complete the proof of Lemma [31 note that if some coordinate of c has 
length at least C\p (where C\ is defined in Proposition HJ), then the lemma 
follows directly with i = 0. Otherwise all entries in c have length less than 
C\p. Thus by Proposition [H all entries of Mc must have length less than 
(Ci/Cs)p. By Proposition [31 if I > C 6 logp, then all coordinates of 



which correspond to an eigenvalue of length less than 1 will, for sufficiently 
large p, all have length less than C5. By Proposition [21 some coordinate of 



will have length at least C5. Thus by Proposition [H there exists a value 
s < C 2 logp such that for sufficiently large p, the coordinate with the largest 
length of 



has length at least {C\/C^)p but no more than p/{2C^) ) and so by Proposi- 
tion m 



has a coordinate of length at least C\p but no more than p/2 if p is sufficiently 



To prove TheoremfH note that if C\p < \c r \ < p/2 for some r in {1, . . . , d}, 







Mc 



large. 



□ 



then 



r=l 
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for some constant Co < d + 1 and 



lA(c) 



1 + Eti9 c 



c 9 

<-rrr<l; 



d+l - d + 1 
otherwise if c ^ 0, then 

lA(c)| < i. 

Suppose p is sufficiently large and s = |_C 2 logpJ. Lemma [21 Lemma [3], and 
the previous observation imply 

C 9 



iA + i(c)i=niA((T^ c 



< 



d + l 

3=0 

for all c ^ 0. Thus if r is a positive integer and c ^ 0, then 

iA (s+ i)(c)i=nniA((T^ +i )c)i< ( c ° xr 

If r is a sufficiently large multiple of logp, then 

c 9 V i 



d + l 



< 



4+1 ' 



d+l J p 
and 

£iA( S+ d(c)I 2 <^. 

c^O 1 

Note that r(s+l) < C(logp) 2 for some constant C > 0. Then, from Lemma[U 
and Lemma if n > C(logp) 2 , then 



||Pn " U\\ < ||P r(s+ l) - C/|| < ^ElA(s + l)(c)| 2 < i - 

as p — > oo. □ 
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5 Proof of Theorem 



2 



Suppose T has an eigenvalue (over C) which is an m-th root of unity. Then 
T m has an eigenvalue 1 over C. So the characteristic polynomial of T m over 
C has 1 as a root. Thus the characteristic polynomial of T m over Z/pZ 
has 1 as a root, and 1 is an eigenvalue of T m over Z/pZ. We can write 
(T m )* = MJM~ l for some matrix J in Jordan block form over Z/pZ and 
so T m = (M-iyjtM*. Thus there exists a basis bi,...,b d for (Z/pZ) d 
over Z/pZ such that if p(v) = a\ when v = aibi + . . . + a^bd, we have 
p(T m bi) = 1 and p(T m bj) = if j = 2, . . . , d. Note that for all n, 

X n+m = T m X n + r m_1 B n + . . . + TB n+m _ 2 + B n+m _! (mod p), 

and so p(X n+m ) = p(T m X n ) +p(T m ~ 1 B n ) + . . . +p(TB n+m _ 2 ) +p(B n+m _ 1 ). 
Note that p(T m X n ) = p(X n ). There are at most d + 1 possible values of 
p(T m_1 B n ), d + 1 possible values of p(TB n+m _ 2 ), and d + 1 possible values 
of p(B n+m _!). So there are at most (d + l) m possible values of j9(T m_1 B n ) + 
. . . + p(TB n+m _ 2 ) + p(B n+m _i). Thus p(X ),p(X m ),p(X 2m ), . . . forms a 
random walk on Z/pZ with support of size u which is at most (d + l) m . 
By Greenhalgh [4J, given e > 0, there exists a value C 2 > such that 
if c < C , 2p 2// ^ u_1 ' ) , then the variation distance of p(X cm ) from uniform in 
TLjpL is at least 1 — e. Thus, in the random process on (Z/pZ) d , we get 
\\Pcm — U\\ > 1 — e. Results of Asci jl] imply that b is no larger than 2. The 
theorem follows. □ 

6 Questions for Further Study 

One question to consider is whether the order (logp) 2 rate of convergence 
can be improved to order (logp) log(logp) similar to Theorem 2 in 0. For 
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diagonal matrices with non-zero eigenvalues all different from ±1, Theorem 
4.5 of Asci pQ confirms this, but for more general cases, the question is 
open. Another question is analogous to one explored in Chung, Diaconis, 
and Graham [2J: Are order logp steps sufficient for typical values of pi 

Another question for further study is to see how large the value b in 
Theorem [2J can be. Also, given e > 0, will there exist a C > such that if 
n < Cp 2 , then \\P n — U\\ > 1 — e for sufficiently large pi 

Another area to explore involves random processes on fields with p d el- 
ements where p is a prime; these random processes would be of the form 
X n+ i = AX n + b n where b n and X n are random variables over this field and 
A is a fixed element of this field. Since elements of this field can be repre- 
sented as a dxd matrix over Z/pZ (see, for example, pp. 64-65 of [5]), perhaps 
some natural connections can be made between the random processes studied 
here and such random processes on finite fields. 
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